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1. Preliminary results. In this Section, we provide some preliminary 
results and algorithms introduced by Andersson [1], Dor and Tarsi [4], and 
Chickering [2, 3]. These results are necessary to implement our proposed 
approach technically. Some definitions and notation are introduced first. A 
graph is called a chain graph if it contains no partially directed cycles [6]. 
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A chord of a cycle is an edge that joins two nonadjacent vertices in the 
cycle. An undirected graph is chordal if every cycle of length greater than 
or equal to 4 possesses a chord. A directed edge of a DAG is compelled if it 
occurs in the corresponding completed PDAG, otherwise, the directed edge 
is reversible and the corresponding parents are reversible parents. Recall 
be the set of all neighbors ofx,Ilx is the set of all parent of x, N^y = N^CiNy 
and ilx,y = ^xr]Ny and the concept of "strongly protected" is presented in 
Definition 1 in the paper [5]. 

1.1. Characterizations of completed PDAGs. Lemma 2 characterizes com- 
pleted PDAGs that arc used to represent Markov equivalence classes [1] and 
will be used in the proofs in Section 3. 

Lemma 2 (Andersson [1]). A graph C is a completed PDAG of a directed 
acyclic graph V if and only if C satisfies the following properties: 

(i) C is a chain graph; 

(ii) Let Cr be the subgraph induced by t. Ct is chordal for every chain com- 

ponent t; 

(iii) w ^ u — V does not occur as an induced subgraph of C; 

(iv) Every arrow v ^ u in C is strongly protected. 

1.2. The necessary and sufficient validity conditions. Lemma 3 shows 
the equivalent validity conditions for iu2, dui, id2, ddi and mvi used in 
Definition 9 in the paper [5]. 

Lemma 3 (Validity conditions of some operators [3]). The necessary and 
sufficient validity conditions of the operators with type of InsertU, DeleteU, 
InsertD, DeleteD or Make V are as follows. 

• (InsertU) Let x and y be two vertices that are not adjacent in C. The 
operator Insert U x — y is valid ( equivalently, iu2 holds ) if and only if 
(iu2.i) Ila; = Jly, (iu2.2) every undirected path from x to y contains a 

vertex in N^y 

• (DeleteU) Let x — y be an undirected edge in completed PDAG C. The 
operator DeleteU x — y is valid (equivalently, dui holds) if and only if 
(dui.i) Nxy is a clique in C. 

• (InsertD) Let x and y be two vertices that are not adjacent in C. The 
operator InsertD x ^ y is valid ( equivalently, id2 holds ) if and only if 
(id2.i) Ha; 7^ IIj^, (id2.2) ^x,y is a, clique, (id2.3) every partially directed 
path from y to x contains at least one vertex in ^x,y ■ 
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• (DeleteD) Let x ^ y be a directed edge in completed PDAG C. The 
operator DeleteD of x ^ y is valid ( equivalently, dd\ holds ) if and 
only i/(ddi.i) Ny is a clique. 

• (MakeV) Let x — z — y be any length-two undirected path in C such that 
X and y are not adjacent. The operator Make V x z -f^ y is valid 
(equivalently, mvi holds) if and only j/(mvi.i) every undirected path 
between x and y contains a vertex in N^y ■ 

1.3. Two algorithms to implement Chickering's approach. Algorithm 3 
generates a consistent extension of a PDAG [4]. Algorithm 4 creates the 
corresponding completed PDAG of a DAG [2] . They are used to implement 
Chickering's approach. 



Algorithm 3: (Dor and Tarsi [4]) Generate a consistent extension of a 

PDAG 

Input: A PDAG V that admits a consistent extension 
Output: A DAG D that is a consistent extension of V. 

1 Let V ~ V; 

2 while V is not empty do 

3 Select a vertex x vnV such that (1) x has no outgoing edges and (2) if A^^; is not 

empty, then every vertex in is adjacent to all vertices in A^a; U Ha;. /* Dor 
and Tarsi [4] show that a vertex x with these properties is 
guaranteed to exist if V admits a consistent extension. */ 

4 Let all undirected edges adjacent to x be directed toward x inV 

5 Remove x and all incident edges from V. 

6 return T> 



2. Additional examples, experiment and algorithms. This sec- 
tion include three parts: (1) some examples to illuminate the methods pro- 
posed in the paper [5], (2) an experiment about v-structures, and (3) three 
algorithms to test the conditions iua, Ida and dd2 in Algorithm l.lonly 
based on ej in an efficient manner. 

2.1. Examples. Four examples are presented to illustrate operators, the 
generation of a resulting completed PDAG of an operator, the conditions 
of a perfect operator set, and the process of constructing a perfect operator 
set. 

Example 1. This example illustrates six operators on a completed PDAG 
C and their corresponding modified graphs. Figure 8 displays six operators: 
InsertU x — z, DeleteU y — z, InsertD x ^ v, DeleteD z ^ v, MakeV 
z y u, and RemoveV z v u. After inserting an undirected edge 
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Algorithm 4: (Chickering [2]) Create the completed PDAG of a DAG 
Input: V, a DAG 

Output: The completed PDAG C of DAG V. 

1 Perform a topological sort on the vertices in "D such that for any pair of vertices x 
and y vciV, X must precede y ii x \s an ancestor of y; 

2 Sort the edges first in ascending order for incident vertices and then in descending 
order for outgoing vertices; Label every edge in T> as unknown; 

3 while there are edges labeled unknown in T> do 

4 Let X — >■ y be the lowest ordered edge that is labeled unknown 

5 for every edge w — ^ x labeled compelled do 

6 if w is not a parent of y then 
x ^ y and every edge incident into y with compelled 

Goto 3 

9 else 

10 1^ Label w ^ y with compelled 

11 if there exists an edge z -> y such that z = x and z is not a parent of x then 

12 ^ Label x —¥ y and all unknown edges incident into y with compelled 

13 else 

14 ^ Label a; — > j/ and all unknown edges incident into y with reversible 

15 Let C = !> and undirect all edges labeled "reversible" in C. 

16 return completed PDAG C 



X — z into the initial graph C, wc get a modified graph denoted as Vi in 
Figure 8. By applying the other five operators to C in Figure 8 respectively, 
we can obtain other five corresponding modified graphs 7^2, 'Pa, 'P4, 'Ps, and 
Vq. Here the operator "MakeV z ^ y -(^ u" modifies z — y — u to z^y^^u 
and the operator "Remove z ^ v u" modifies z^v-<^utoz — v — u. 
Notice that a modified graph might not be a PDAG though all modified 
graphs in this example are PDAGs. 

In the above example, wc see that the modified graph of an operator, 
denoted by V, might be a PDAG, but might not be a completed PDAG. 
For example, the modified graphs V4, and Vq in Figure 8 are not completed 
PDAGs because the directed edge y ^ v is not strongly protected. 

Example 2. This example illustrates Chickering's approach to obtain 
the resulting completed PDAG of a valid operator from its modified graph. 
Consider the initial completed PDAG C and the operator "Remove z — )■ f <— 
■u" in Figure 8. We illustrate in Figure 9 the steps of Chickering's approach 
that generates the resulting completed PDAG Ci by applying "Remove z — >■ 
V u" to C The first step (step 1) extends the modified graph (a PDAG 
Vq) to a consistent extension {Vq) via Algorithm 3. The second step (step 
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Fig 8. Examples of six operators of PDAG C. Vi to Ve are the modified graphs of six 
operators. 

2) constructs the resulting completed PDAG Ci of the operator "Remove 
z V <— u'^ from the DAG via Algorithm 4. 

Example 3. This example illustrates that O in Equation (3.3) will not be 
reversible if condition iu3 or dd2 is not contained in Definition 9. Consider 
the operator set O defined in Equation (3.3) for ^5 and the completed 
PDAG C G 55 in Figure 10. We have that operator InsertU z — u and 
DeleteD z ^ v are valid. As shown in Figure 10, InsertU z — u transfers C 
to the completed PDAG Ci and DclctcD z ^ v transfers C to the completed 
PDAG €2- However, deleting z—u from Ci will result in an undirected PDAG 
distinct from C and InsertD z ^ v is not valid for C2. As a consequence, 
if O contains InsertU z — u and DeleteD z ^ v, it will be not reversible. 
According to Definition 9, these two operators do not appear in Oc because 
they do not satisfy the conditions iu3 and dd2 respectively. 

Example 4. This toy example is given to show how to construct a con- 
crete perfect set of operators following Definition 9 in the paper [5] . Consider 
the completed PDAG C in Example 3. Here we introduce the procedure to 
determine InsertUc- All possible operators of inserting an undirected edge 
to C include: "InsertU x — z" , "InsertU x — u" , "InsertU x — u" and "InsertU 
z — u" . The operator "InsertU x — v" is not valid according to Lemma 3 
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Initial modified consistent the resulting 
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(apply 

operator) //*\ step 1 






Fig 9. Example for constructing the unique resulting completed PDAG of a valid operator. 
An operator "Remove z ^ v <^ u" in Figure 8 is applied to the initial completed PDAG 
C and finally results in the resulting completed PDAGCi. 



XXX 




Fig 10. Example: Two valid operators bring about irreversibility. It shows valid conditions 
are not sufficient for perfect operator set. 



since n(a:) 7^ n(t'). The operator "InsertU z — u" is valid; however, con- 
dition iu3 does not hold. According to Definition 9 in the paper [5], we 
have that only "InsertU x — z" and "InsertU x — u" are in InsertUc- Thus 
InsertUc = {x — z,x — u}, where "x — z" denotes "InsertU x — z" in the 
set. Table 1 lists the six sets of operators on C. 

2.2. Experiment about v-structures. Below, we present the experiment 
result in Figure 11 about the numbers of v-structures of completed PDAGs 
in Sp^. 

For in the main window, the medians of the four distributions are 

108, 220, 557 and 1110 for j9=100, 200, 500, and 1000 respectively. Figure 
11 shows that the numbers of v-structures are much less than {jp^) for most 
completed PDAGs in Sp^ when r is set to 1.2, 1.5 or 3. This result is useful to 
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Fig 11. The distributions of the numbers of v- structures of completed PDAGs in S. 
red lines in the boxes indicate the medians. 
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2.3. Three Algorithms to check iu^, id^ and dd2 in Algorithm 1.1. The 
conditions iu3 , ids and dd2 in the fourth group depend on both et and the re- 
sulting completed PDAGs of the operators. Intuitively, checking these three 
conditions requires that we obtain the corresponding resulting completed 
PDAGs. We know that the time complexity of getting a resulting completed 
PDAG of et is 0{pne^) [3, 4], where n^^ is the number of edges in Cf. To 
avoid generating resulting completed PDAG, we provide three algorithms 
to check iu3, ids and dd2 respectively. 

In these three algorithms, we use the concept of strongly protected edges, 
defined in Definition 2. Let A^, contain all vertices adjacent to v. To check 
whether a directed edge f — t- n is strongly protected or not in a graph Q, 
from Definition 2, we need to check whether one of the four configurations 
in Figure 1 occurs in Q. This can be implemented by local search in A„ and 
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A^. We know that when a PDAG is sparse, in general, these sets are small, 
so it is very efficient to check whether an edge is "strongly protected" . 

We arc now ready to provide Algorithm 1.1.1, Algorithm 1.1.2, and Al- 
gorithm 1.1.3 to check iu3, Ida and dd2 only based on ej, respectively. In 
these three algorithms, we just need to check whether a few directed edges 
are strongly protected or not in Vt+i, which has only one or a few edges 
different from et- We prove in Theorem 2 that these three algorithms are 
equivalent to checking conditions ius, ids and dd2, respectively. 



Algorithm 1.1.1: Check the condition ius in Definition 9 
Input: a completed PDAG et and a valid operator on it: InsertU x — y. 
Output: True or False 

1 Insert x — y to et, get the modified PDAG denoted as Vt+i, 
1 for each common child u of x and y in Vt+i do 

3 if either x — > ti or y u is not strongly protected in Vt+i then 

4 ^ return False 

5 return TYue (ius holds for InsertU x — y) 



Algorithm 1.1.2: Check the condition ids in Definition 9 
Input: a completed PDAG et and a valid operator: InsertD x y. 
Output: True or False 

1 Insert x y to et, get a PDAG, denoted as Vo, 

2 for each undirected edge u — y in Vo, where u is not adjacent to x do 

3 ^ update Vo by orienting u — y to y u, 

4 for each edge v y in Vo do 

5 if V y is not strongly protected in Vo then 

6 ^ update Vo by changing v y to v — y, 

7 Set Vt+i = Vo 

8 for each common child u of x and y in Vt+i do 

9 if y u is not strongly protected in Vt+i then 

10 ^ return False 

11 return TWte (ids holds for InsertD x y) 



Theorem 2 (Correctness of Algorithms 1.1.1, 1.1.2 and 1.1.3). Let et 
be a completed PDAG. We have the following results. 

(i) Let InsertU x ~ y be any valid operator of et, then condition iu^ holds 
for the operator InsertU x — y if and only if the output of Algorithm 
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Algorithm 1.1.3: Check the condition dd2 in Definition 9 

Input: a completed PDAG et and a valid operator DeleteD x — > j/ 
Output: True or False 

1 Delete x ^ y from et. get a PDAG, denoted as Vt+i', 

2 for each parent v of y m Vt+i do 

3 if V ^ y is not strongly protected in Vt+i then 



5 return True ( dd2 holds for DeleteD x -> y) 



1.1.1 is True. 

(ii) Let InsertD x ^ y be any valid operator of et, then condition id^ holds 
for the operator InsertD x ^ y if and only if the output of Algorithm 

1.1.2 is True. 

(iii) Let DeleteD x y be any valid operator of et, then condition dda holds 
for the operator DeleteD x y if and only if the output of Algorithm 

1.1.3 is True. 

In Theorem 2, we show that an algorithm (Algorithm 1.1.1, Algorithm 
1.1.2, or Algorithm 1.1.3) returns True for an operator if and only if the 
corresponding condition (iua, ids or dd2) holds for the operator. Theorem 
2 says that we do not have to examine the resulting completed PDAG to 
check conditions ius, ids and dd2, which saves much computation time. 

3. Proofs. We will provide a proof of Theorem 1, the main result of 
the paper [5], in Subsection 3.1, and a proof of Theorem 2 in Subsection 
3.2 below. Notice that we present Theorem 2 in Subsection 2.3 to show the 
correctness of Algorithm 1.1.1, Algorithm 1.1.2 and Algorithm 1.1.3. 

3.1. Proof of Theorem 1 in the paper [5]. Let O be the operator set 
defined in Equation (3.3); to prove Theorem 1, which shows O is a perfect 
operator set, we need to show O satisfies four properties: validity, distin- 
guishability, irreducibility and reversibility. Equivalently, we just need to 
prove Theorem 3-6 as follows: 

Theorem 3. The operator set O is valid. 

Theorem 4. The operator set O is distinguishable. 



4 




Theorem 5. The operator set O is reversible. 
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Theorem 6. The operator set O is irreducible. 

Of the above four theorems, the most important and difficult is to prove 
Theorem 5. We now show the proofs one by one. 
Proof of Theorem 3 

According to the definition of vaHdity in Definition 5 and the definition 
of Oc in Equation (3.2), all operators in InsertUc, DeleteUc, InsertDc, 
DeleteDc and MakeVc are valid. We just need to prove Lemma 4, which 
shows all operators in RemoveVc are valid. 

Lemma 4. Let x ^ z y he a v-structure in completed PDAG C. If 
(rvi) Hx = liy, (rv2) Ilx^Nxy = Ilz\{x,y}, and (rvs) every undirected path 
between x and y contains a vertex in N^y hold, then the operator Remove V 
X ^ z ^ y is valid and results in a completed PDAG in Sp defined in 
Equation (3.1). 

To prove Lemma 4, we will use Lemma 5 given by Chickering (Lemma 32 
in [3]). 

Lemma 5. Let C be any completed PDAG, and let x and y be any pair of 
vertices that are not adjacent. Every undirected path between x and y passes 
through a vertex in Nxy if and only if there exists a consistent extension in 
which (1) X has no reversible parents, (2) all vertices in N^y are parents of 
y, and (3) y has no other reversible parents. 

We now give a proof of Lemma 4. 

Proof. Prom Lemma 5 and condition rv3 in Lemma 4, there exists a 

consistent extension of C, denoted by T>, in which x has no reversible parents 
and the reversible parents of y are the vertices in N^y. Because y ^ z occurs 
in the completed PDAG C, and Ny occur in different chain components. 
We can orient the undirected edges adjacent to z out of z. Then all vertices 
in Nz arc children of z in T>. Let T>' be the graph obtained by reversing y ^ z 
in V and V' be the PDAG obtained by applying the RemoveV operator to 
C. We will show that V is a consistent extension of V. 
Clearly, V' and T" have the same skeleton. 

We have that any v-structure that occurs in T> but not in V' must include 
either the edge a; — t- z or y — t- z. Since T> is a consistent extension of C, we 
have that all v-structures in D are also in C. From condition rv2, all parents 
of z other than x and y are adjacent to x and y. Hence x z y is the 
only v-structure that is directed into z in C. We have that all v-structures 
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of V' are also in T>, and there is only one v-structure x ^ z y that is in 

V but not V'. 

Since y — t- z is the unique edge that differs between T) and D', we have 
that any v-structure that exists in P but not in V' must include the edge 
y ^ z, and any v-structure that exists in V but not in V must include 
the edge z ^ y. We have shown that x — > z y is the only v-structure 
in T> that is directed into z. From the construction of P, we have that all 
compelled parents of y in V' are also parents of z and all other parents are 
in Nxy] from rv2, they also are parents of z. There is no v-structure that 
includes edge z^yinV'. Hence, all v-structures of V are also in V, and 
there is only one v-structure x ^ z y that is in D but not T>'. 

Hence, V and V' have the same v-structures. It remains to be shown that 

V is acyclic. 

If V contains a cycle, the cycle must contain the edges z ^ y because 
T> is acyclic. This implies there is a directed path from y to z in D. By 
construction, all vertices in are children of z in T>' . So, this path must 
include a compelled parent of z, denote it by u. U u x, from condition 
rv2, u G IlyljNxy; by the construction of V, we have u G Hj^. Thus, there 
is no path from y to z that contains u. If u = x, by construction, the path 
must contain a compelled parent v of x. From condition rvi, v G H^. Thus, 
there is no path from y to z contains v. We get that P' is acyclic. Thus V 
is a consistent extension of V and the operator RemoveV x ^ z y is 
vahd. □ 

Proof of Theorem 4 

Proof. For any completed C G Sp, we need to show that different op- 
erators in Oc result in different completed PDAGs. For any valid operator 
o G InsertUc, say InsertU x — y, denoted as o, the resulting completed 
PDAG of o contains the undirected edge x — y. We have that all other op- 
erators in Oc except for InsertD x — > y and Insert x y (if they are also 
valid) will result in completed PDAGs with skeletons different than the re- 
sulting completed PDAG of o. Thus, these operators can not result in the 
same completed PDAG as o. If InsertD x — t- y or Insert x y is valid, the 
resulting completed PDAGs of them contain x — t- y or x ^ y. These two 
resulting completed PDAGs have at least a compelled edge different than 
the resulting completed PDAG of o. Thus, there is no operator in Oc that 
can result in the same completed PDAG as o. 

Similarly, we can show for any operator in Oc, different operators will re- 
sult in different completed PDAGs, because they will have distinct skeletons, 
compelled edges, or v-structures. □ 
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Proof of Theorem 5. 

Let C be any completed PDAG in Sp, o € Oc be an operator on C. The 
operator o' G C is the reversible operator of o if o' can transfer the resulting 
completed PDAG of o back to C. To prove Theorem 5, we just need to show 
each operator in Oc defined in Equation (3.3) has a reversible operator 
in O. Equivalently, we prove Lemma 6, Lemma 7, Lemma 8, Lemma 9, 
Lemma 10, and Lemma 11 to show the reversibility for six types of operators 
respectively. 

Lemma 6. For any operator o G Oc denoted by "InsertU x — y", the 
operator "DeleteU x — y" is the reversible operator of o. 

Lemma 7. For any operator o G Oc denoted by "DeleteU x — y", the 
operator "InsertU x — y" is the reversible operator of o. 

Lemma 8. For any operator a G Oc denoted by "InsertD x ^ y", the 
operator "DeleteD x y" is the reversible operator of o. 

Lemma 9. For any operator a G Oc denoted by "DeleteD x y", the 
operator "InsertD x y" is the reversible operator of o. 

Lemma 10. For any operator a e Oc denoted by "MakeV x z y", 
the operator "RemoveV x —^z-(—y"is the reversible operator of o. 

Lemma 11. For any operator a e Oc denoted by "RemoveV x z ■h- 
y", the operator "MakeV x —^z-(—y"is the reversible operator of o. 

Before giving proofs of these six lemmas, We first provide several results 
shown in Lemma 12, 14, 13, and Lemma 15. 

Lemma 12. Let graph C be a completed PDAG, {w,v,u} be three ver- 
tices that are adjacent each other in C. If there are two undirected edges in 
{w,v,u}, then the third edge is also undirected. 

Proof. If the third edge is directed, there is a directed cycle like w — 
V — u ^ w. Prom Lemma 2, we know that C is a chain graph, so there is no 
directed circle in C □ 

Lemma 13. Let Ci be the resulting completed PDAG obtained by insert- 
ing a new edge between x and y in C. If there is at least one edge f — )■ u that 
is directed in C but not directed in Ci, then there exists a vertex h that is 
common child of x and y such that x ^ h and y ^ h inC become undirected 
in C\. 
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Proof. According to Lemma 2, an edge is directed in a completed PDAG 
if and only if it is strongly protected. Thus, we have that at least one case 
among (a), (b), (c), (d) in Figure 1 occurs in C but not in Ci for v ^ u. We 
will show that either Lemma 13 holds or there exists a parent of u, denoted 
as ui, such that U2 — ^ tii occurs in C but not in Ci, where U2 is a parent of 
ui. We denote the latter result as (*). 

Suppose case (a) in Figure 1 occurs in C but not in Ci. Because v ^ u 
becomes undirected in Ci, we have that w ^ v must be undirected in Ci 
since w and u are not adjacent. Set ui = v and U2 = u, and we have that 
(*) holds. 

Suppose case (b) in Figure 1 occurs in C but not in Ci. If the pair {v,w} 
is not {x, y}, V u w is a v-structure in C. We have that v ^ u occurs 
in Ci. This is a contradiction. If {v,w} is {x,y}, we have that Lemma 13 
holds {h = u). 

Suppose case (c) in Figure 1 occurs in C but not in Ci. Either v ^ w 
oi w ^ u occurs in C but not in Ci. If it is u — > by setting U2 = v and 
ui = w, we have (*) holds. If it is to — >■ u, both v — u and u; — u in Ci, so 
X — u also must be in Ci. We also have that (*) holds. 

Suppose case (d) in Figure 1 occurs in C but not in Ci. If the pair {w, wi} 
is {x,y}, Lemma 13 holds (h = u). Otherwise, w —>«•(— must occur in 
both Ci and C and the edge v ^ u is still strongly protected in Ci , yielding 
a contradiction. 

If (*) holds, we have that there is a directed path n2 — > ni — t- u such 
that U2 — )• ui occurs in C but not Ci. Iterating, we can get a directed path 
Uk Uk-i • • • u of length k — 1 without undirected edges such that 
Uk — > Uk-i occurs in C but not in Ci if Lemma 13 does not hold in each step. 
Because C is a chain graph without directed circle, the procedure will stop 
in finite steps and Lemma 13 will hold eventually. □ 

Prom the proof of Lemma 13, we have that u should be a descendant of 
X and y, so we can get the following Lemma 14. 

Lemma 14. Let C be any completed PDAG, and let V denote the PDAG 
that results from adding a new edge between x and y. For any edge v ^ u 
in C that does not occur in the resulting completed PDAG extended from V, 
there is a directed path of length zero or more from both x and y to u in C. 

Lemma 15. Let InsertUc and DeleteUc be the operator sets defined in 
Definition 9 respectively. For any o in InsertUc or in DeleteUc, where V' 
is the modified graph of o that is obtained by applying o to C, we have that 
V' is a completed PDAG. 
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Proof. We just need to check whether V' satisfies the four conditions in 
Lemma 2. 

(i) : For any o G Deletellc, denoted as DeleteD x—y, let V be the modified 
graph obtained by deleting x — y from C. 

If there is a directed cycle in V' , it must be a directed cycle in C, which 
is a contradiction. Thus, there is no directed cycle in V' and V' is a chain 
graph. 

If there exists an undirected cycle of length greater than 3 without a chord 
in V' , the cycle must contain both x and y; otherwise, this cycle occurs in C. 
If the length of the cycle is 4, the other two vertices are in Nxy] we have that 
the cycle has a chord since N^y is a clique in C. If the cycle in T" has length 
greater than 4 without a chord, we have that x — y is the unique chord of this 
cycle in C. However, this would imply that there is a cycle of length greater 
than 3 without a chord in C, a contradiction. Thus, there is no undirected 
cycle with length greater than 3 in T", so every chain component of V' is 
chordal. 

Suppose that •—).• — • occurs as an induced subgraph of V; it must be 
X - —y (or y — >■ • — x) . However, in this case, x - — y — x (or y ^ ■ — x — y) 
would be a directed cycle in C. Thus the induced subgraph like — • 

does not occur as an induced subgraph of V' . 

Finally, all directed edges in V' will be strongly protected; by the definition 
of strong protection, all directed edges in C will remain strongly protected 
when an undirected edge is removed. 

(ii) : For any o G InsertUc, denoted as InsertU x — y, V is the modified 
graph of o. 

If there is a directed cycle in V' , it must contain x — y, otherwise this 
cycle is also in C. We can suppose that there exists a partially directed path 
from x to y in C Denote the adjacent vertex of y in the path as u. Let u be 
the vertex adjacent to y in the path. We have u ^ Hy-, otherwise, from the 
condition H^; = Hy in Lemma 3, u would also be in H^;, so there would be a 
partially directed cycle from x to x in C. Hence the directed path must have 
the form x - ■ ■ — > ■ ■ - u — y. This would induce a subgraph like a — > 6 — u in 
C, a contradiction. Consequently, V' is a chain graph. 

If there exists an undirected cycle of length greater than 3 without a chord 
in ■p', the cycle must contain x and y, and there must be an undirected path 
from X to y in C; otherwise, the cycle would also be in C. From Lemma 3, 
every undirected path from x to y contains a vertex in N^y, so every undi- 
rected path of length greater than two has a chord. Thus, every undirected 
path of length greater than 3 from x to y in V' has a chord. This implies 



REVERSIBLE MCMC ON MARKOV EQUIVALENCE CLASSES OF SPARSE DAOS 



that every chain component of V' is chordal. 

Suppose that a subgraph like — ■ occurs as an induced subgraph 

of V' ■ Since lix = in C, the induced subgraph is not ■ ^ x — y (or 
• — > y — x). Thus, the induced subgraph hke •—).• — • also occurs in C. This 
is a contradict since C is a completed PDAG, yielding a contradiction. 

Prom Lemma 13 and the condition iu3 in Definition 9, all directed edges 
in C are also directed in Ci . This implies that all directed edges in V are still 
compelled, and are thus strongly protected. 

□ 

We now give proofs of Lemma 6, Lemma 7, Lemma 8, Lemma 9, Lemma 
10, and Lemma 11 one by one. 
Proof of Lemma 6 

Proof. Because the operator "InsertU x — y" = o G Oc is valid and Ci 
is the resulting completed PDAG of o, we have that x — y occurs in Ci . We 
just need to show that the common neighbors of x and y, denoted as N^y, 
form a clique in Ci. 

If Nxy is empty set or has only one vertex, the condition that N^y is a 
clique in Ci holds. 

If there are two different vertices z, u G N.,;y in Ci, we have that x — z — y 
and X — u — y form a cycle of length of 4 in Ci. The cycle is also in C. Since 
the edge x — y does not exist in C and C is a completed PDAG in which all 
undirected subgraphs are chordal graphs, we have that z — u occurs in C, so 
z and u are adjacent in Ci. Hence the condition that Nxy is a clique in Ci 
holds. □ 

Proof of Lemma 7 

Proof. We need to show the operator o' := InsertU x — y, satisfies the 
conditions iui , iu2 and ius in Definition 9 for completed PDAG Ci and that 
the resulting completed PDAG of o' is C. 

The condition iui clearly holds, since x — y exists in Ci but not in C. 
Lemma 15 implies that the graph obtained by deleting x — y from C is the 
completed PDAG Ci. Thus, the graph obtained by inserting x — y into Ci is 
C. This implies that InsertU x — y is valid and the condition iu2 holds. 

Lemma 15 implies that the condition iu3 also holds. □ 

Proof of Lemma 8 

Proof. I will first show that there is no undirected edge y — w that occurs 
in both C and Ci. li w — y occurs in C, since x and y are not adjacent in 
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C, X ^ w — y does not occur in C. There are three possible configurations 
between x and w in C: (1) x is not adjacent to w, (2) w ^ x, and (3) x — w. 
If X is not adjacent to in C, inserting x ^ y will result in y — )■ in Ci . If 
w ^ X \s\nC, inserting x ^ y will result in u; y in Ci. If a; — in C, there 
is an undirected path from y to x; that is, the first condition for InsertD to 
be valid, according to Lemma 3, does not hold. Thus, we get that there is 
no undirected edge y — w that occurs in both C and Ci . 

For any w ^ Ny in Ci, the edge between w and y is directed in C; that is, 
either w y oi y ^ w occurs in C If y ^ i/; is in C, there are three possible 
configurations between x and w in C: (1) x is not adjacent to w,{2) w ^ x, 
and (3) x ^ w. If x and w are not adjacent in C, inserting x — t- y will result 
in 2/ ^ w in Ci. If if; ^ X occurs in C, inserting x — > y is not valid for C 
since there would be a directed path from y to x. li x ^ w occurs in C, w 
is common child of x and y, so from condition ids, y w occurs in Ci and 
w ^ Ny in Ci. Thus, we have that w ^ y must be in C 

If there is another vertex v G Ny in Ci, v ^ y must also be in C. If 
and w are not adjacent, v ^ y ■(^ w forms a v-structure both in C and in 
Ci. w y must occur in Ci and, consequently, w ^ Ny in Ci yielding a a 
contradiction. Thus, wc know that any two vertices in A'j^ arc adjacent in C. 
Ny is therefore a clique in Ci and the operator DeleteD a; ^ y is valid for 
Ci; that is, the condition idi in Definition 9 holds. 

Denote the modified PDAG of operator DeleteD x ^ y oi Ci asV'. We 
need to show that the corresponding completed PDAG of V' is C Equiv- 
alently, we just need to show V' and C have the same skeleton and v- 
structures. Clearly, V' and C have the same skeleton. If there is a v-structure 
in C, but not in Ci, it must be x — >■ n ■<— y, where u is a common child of x 
and y. From condition Ida in Definition 9, x — t- u and y u also occur in 
Ci, so, these v-structures also exist in V' . This implies that all v-structurcs 
of C are also in V' . Moreover, the v-structures in Ci but not in C must be 
X — > y ■<— V, where v is parent of y, and x and v are not adjacent in Ci. 
Clearly, after we delete x ^ y from Ci, these v-structures will not exist in 
V'. This implies that all v-structures of are in C. So, and C have the 
same v-structures. 

For any v y in Ci, ii v — y is in C , v must be parent of x. If x and v 
are not adjacent, inserting x — > y to C will result in y v in Ci. Moreover, 
x — V — y does not exist in C since InsertD x — t- y is a valid operator, and 
X ^ V — y does not occur in C. Thus, for any v that is a parent of y but not 
a parent of x, the directed edge v y also occurs in the resulting completed 
PDAG C. That is, the condition id2 in Definition 9 holds. 

□ 
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Proof of Lemma 9 

To prove this lemma, we first introduce Lemma 16 and Lemma 17. Let 

L = (ui, U2, ■ ■ ■ , Ufe) be a partially directed path from ui to in a graph. 
A path L2 = {u^, ■ ■ ■ ,u^) is a sub-path of Li if all vertices in Li are in L 
and have the same order as in L. We say that a partially directed path is 
shortest if it has no smaller sub-path. 

Lemma 16. Let C be a completed PDAG, and let Li be a partially di- 
rected path from y to x in C. Then there exists a shortest sub-path of L\, 
denoted as L2 = y — ui — ■ ■ ■ — Uk ^ ■ ■ ■ ^ x , in which there exists a k such 
that all edges occurring before Uk in the path are undirected, and all edges 
occurring after Uk are directed. 

Proof. We just need to show that a directed edge must be followed by a 
directed edge in the shortest sub-path. If not, Ui — )• Wj+i occurs in L2. 

Because C is a completed PDAG, Ui and Ui+2 must be adjacent; otherwise 
Ui+i — > occurs in C. If — >■ Ui+2 occurs in C, L2 is not a shortest path. 
If Ui Ui+2 occurs in C, Uj+i Ui+2 must be in C. 

□ 

Lemma 17. // the graph Vi obtained by deleting a ^ b from a completed 
PDAG C can be extended to a new completed PDAG, Ci, then we have that 
for any directed edge x ^ y in C, if y is not b or a descendent of b, then 
X y occurs in Ci . 

Proof. Because x ^ y occurs in C, so it is strongly protected in C. 
If x — > y does not occur in Ci, it is not strongly protected in Ci from 
Lemma 2. From the definition of strongly protected, we know that the four 
cases in Figure 1 in which v ^ u is strongly protected do not involve any 
descendant of u. Thus, if x — >■ ?/ is not compelled in Ci, there must exist 
a directed edge w ^ z between two non-descendants of y such that the 
edges between non-descendants of z are strongly protected and w — z is no 
longer strongly protected in Vi- Because Vi is obtained by deleting a ^ b, 
z is non-descendant of b, we have that u) — )• z is strongly protected in Vi, 
yielding a contraction. □ 

We now give a proof of Lemma 9 

Proof. Since C G 5^ , we have nci < n. That is, the condition idi in 
Definition 9 holds for InsertD .x y of Ci. 

For any undirected edge w — y inC, x must be parent of w, otherwise the 
edge between y and w is directed. Then deleting x ^ y from C will result 
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in — >■ y in Ci. Thus, we have that all Ny in C become parents of y in Ci. 
Prom the condition dd2, the parents of y but not x in C are also parents of y 
in Ci. If there is a partially directed path from y to x in Ci, then the vertex 
adjacent to y in this path must be a child of y or a vertex that is parent of 
y and x in C. We will show that if the vertex is not a parent of y and x in 
C, there exists a contradiction. 

If there is a partially directed path from y to x in Ci , we can find a shortest 
partially directed path like y — ui — ■ ■ ■ — Uk — )■ ••• — )■ x from Lemma 16, 
denoted as Li. Any directed edge, say Ui iti+i, in Li does not become 
Ui Uj+i in C. If Li does not include undirected edges in Ci, we have that 
the vertices of Li form a partially directed cycle in C. We just need to show 
that the vertices of the undirected path Li also form a partially directed 
path in C. 

Suppose y — > ui occurs in C. If ui — U2 is undirected in C, then y ^ U2 

must occur in C, consequently, Li will not be shortest in Ci. If U2 — )• ui 
occurs in C, there exists a v-structure U2 ui y in Ci otherwise U2 and 
y are adjacent, and Li is not the shortest path in Ci. Thus, ui U2 must 

occur in C. In this manner, we get that all edges in y—ui — • n^— >x 

are directed in C and are directed from Ui — )■ Uj+i. This implies that there 
exists a partially directed cycle in C. So, ui must be a parent of y and x in 
C. We have ui G Qxy and every partially directed path of Ci from y to x 
contains at least one vertex in ilxy 

Since all vertices in Qxy in Ci are parents of x and y in C, if there are two 
vertices, say wi,W2 G ^xy, that are not adjacent, the subgraph wi ^ y W2 
could be a v-structure in Ci. So, all vertices in flxy in Ci are adjacent and 
flxy is a clique. 

We have that the parents of y in Ci {{Ily)ci) is in the union of the parents 
and neighbors of y in C ((n.y IJ A^y)ci). If there is at least one neighbor u 
of y in C, u must be child of x in C and parent of y in Ci, so parents of x 
and y are not the same. If there is no neighbor of y in C, the parents of y 
in Ci is the same as in C except those vertices that are parents of x that is 
(Ily — IIa:)ci = (Ily — Ilx)c- At the same time, from Lemma 17, the parents 
of X in Ci are also the parents of x in C. Thus, the parents of x and y are 
not the same in Ci. Prom Lemma 3, we have that InsertD x — > y is valid for 
Ci and the condition id2 holds. 

Denote the modified PDAG of operator InsertD x — t- y of Ci as V' . We 
need to show that the corresponding completed PDAG of V' is C. Equiv- 
alently, we just need to show that V and C have the same skeleton and 
v-structures. Clearly, V' and C have the same skeleton. A v-structures that 
is in C but not in Ci must have the form x ^ y u, where u is parent of 
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y but not adjacent to x. Prom condition dd2 in Definition 9, u — > y also 
occurs in Ci, so, such a v-structure must also exist in V' . This implies that 
all v-structures of C are also in V' . Moreover, the v-structures in Ci but not 
in C must have the form x ^ v y, where u is a common child of y and 
X in Ci. Clearly, after we insert x ^ y to Ci, this is no longer a v-structure 
in T" implying that all v-structures of T" are in C. Thus, T" and C have the 
same v-structures. 

Let the modified graph of DeleteD x ^ y from C he V; we know that V 
and Ci have the same v-structures. Thus, for any u that is a common child 
of X and y in Ci, x ^ u y is a v-structure in V. This implies that y ^ u 
occurs in C and the condition ids hold. □ 

Proof of Lemma 10 

Proof. Since x, z and y are in the same chain component of C, they have 
the same parent set in C. The modified graph of o' has the same skeleton 
and v-structures as Ci because all compelled edges in C remain compelled 
in Ci. We just need to prove that the operator o' is valid, equivalently, to 
prove that the conditions rmi, rm2 and rm^ hold for Ci. 

We now show that the condition rmi, x and y have the same parents in 
Ci holds. Because x and y have the same parents in C and all directed edges 
in C occur in Ci, we just need to consider the neighbors of x or y. Let w — y 
he any undirected edge in C, we consider the edges between w and x or z. 

1. If both w — z and x — w occur in C, w — y and w — x must be undirected 
in Ci. 

2. Uw — z occurs but x — w does not occur in C, z ^ w and y ^ w must 
be in Ci . 

3. If x — w occurs but w — z does not occur in C, there is an undirected 
cycle of length 4 without a chord in C. Thus, this case will not occur. 

4. If neither w — z nor x — w occur in C, and there is no undirected path 
other than w — y — z from w to z in C, then w — y occurs in Ci. If 
there exists another undirected path from w to z, there must exist an 
undirected path of length 2 like w — u' — zinC, and y is adjacent to u'. 
In this case, y — w occurs in Ci when x — u' occurs and y w occurs 
when X and u' are not adjacent. 

Thus, there are no neighbors of y in C that become parents of y in Ci; 
i.e., y has the same parents in both Ci and C. Similarly, x has the same 
parents in both Ci and C. we get x and y have the same parents in Ci, and 
the condition rmi holds. 



20 



Y.B. HE ET AL. 



All parents of x must also be parents of z in C\ since they are in the 
same chain component. For any w G N^y, w — z also occurs in C; otherwise 
X — z — y — w — X would form cycle of length 4 without a chord. We have 
w ^ z must be in Ci, otherwise a new v-structure will occur in Ci. Thus, 
we have U{x) U N^y C U(z) in Ci. 

For any w G n(^;) in Ci, if w € n(z) in C, it must also be parent of x,y 
and z in Ci, so w £ n(x) in Ci. If w — z is an undirected edge in C, there 
exist undirected edges w — x and w — y in C such that -u; — ^ is in Ci . Thus, 
w e Nxy in Ci. We have that w G n(x) U A^^^y and 11(2;) C Yi{x) U N^y in Ci. 
Thus, n(z) = n(x) U in Ci and the condition rm2 holds. 

Any undirected path between x and y in Ci will also be an undirected 
path in C, so, these paths contain at least one vertex in Nxy in C. From the 
proof above, any vertex in N^y in C is also a vertex of N^y in Ci. Thus, any 
undirected path between x and y contains a vertex in N^y in Ci and the 
condition rms holds. □ 

Proof of Lemma 11 

Proof. From Lemma 5 and the condition rms, there exists a consistent 
extension of C, denoted by P, such that all neighbors of x in C are children of 
X in V, and all neighbors ofyinC are parents of x in V. Changing y ^ z to 
z y inT>, we obtain a new graph T>'. From the proof of Lemma 4, we can 
get that (1) D' is a DAG, (2) T>' is a consistent extension of Ci. Thus, P is a 
consistent extension of the PDAG that results from making the v-structure 
X ^ z y in Ci. Thus, we can get C by applying MakeV x ^ z y to Ci. 
This implies that MakeV x ^ 2; y is a valid operator of Oi and satisfies 
the condition mvi. □ 

Proof of Theorem 6. 

In order to prove this theorem, we first prove some results shown in 
Lemma 18, Lemma 19 and Lemma 20. 

Lemma 18. For any completed PDAG C containing at least one undi- 
rected edge, there exists an undirected edge x — y for which N^y is a clique. 

Lemma 19. For any completed PDAG C, if x y occurs in C, then 

U^^UyX X. 

A proof of Lemma 18 and Lemma 19 can be found in Chickering [3]. 



REVERSIBLE MCMC ON MARKOV EQUIVALENCE CLASSES OF SPARSE DACm 



Lemma 20. For any completed PDAG C containing no undirected edges 
and at least one directed edge, there exists at least one vertex x for which 
any parent of x has no parent. 

Proof. The following procedure will find the vertex whose parent has 
no parent. Let a — > 6 be a directed edge in C, set y = a and x = b. 

1. If Ily is not empty, choose any vertex u in Hy, set x = y and y = u. 
Repeat this step until we find a directed edge y x for which Ily is 
empty. 

2. Since 11^ is empty, from Lemma 19, there exists at least one vertex 
other than y in XIj,. If there is a vertex u E Tlx and u ^ y such that 
n„ is not empty, choose a vertex in n„, denoted as v and set y = v 
and x = u, and go to step 1. 

Since C is an acyclic graph with finite vertices, above procedure must end 
at the step in which the parents of x have no parents. □ 

We now show a proof of Theorem 6. 

Proof. We need to show that for any two completed PDAGs Ci,C2 G S, 
there exists a sequence of operators in O such that C2 can be obtained by 
applying a sequence of operators to PDAGs, starting from Ci. Because O is 
reversible, any operator in O has a reversible operator, so we just need to 
show that any completed PDAG can be transferred to empty graph without 
edges. The procediuc includes three basic steps. 

1. Deleting all undirected edges. 

From Lemma 18, for any completed PDAG containing at least one undi- 
rected edge, we can find an operator with type of DeleteU that satisfies the 
condition dui in Definition 9. We can delete an undirected edge with this 
operator and get a new completed PDAG whose skeleton is a subgraph of 
the skeleton of the initial completed PDAG. Repeating this procedure, we 
can get a completed PDAG, denoted as Ci, which contains no undirected 
edges. 

2. Deleting some directed edges. 

From Lemma 20, we can find a vertex, denoted as x, whose parents have 
no parents in the completed PDAG Ci. If n^; contains more than two vertices, 
we can choose a vertex u eUx- Because (1) is empty in Ci and (2) any 
other directed edge v ^ x forms a v-structure in Ci, we have that f — t- .x is 
also compelled in the completed PDAG obtained by deleting directed edge 
u — >■ X from Ci. We can delete v ^ x from Ci and get a new completed PDAG 
whose skeleton is a subgraph of the skeleton of the initial one. Thus, the new 
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completed PDAG is in <S. Repeat this procedure for all other directed edges 
v' ^ X in which v' € Ilx until there are only two vertices in in the new 
completed PDAG, denoted as Cj. 
3. Remove a v-structure. 

The conditions rm i, rm2 and rma hold for the v-structure y — )• x ■<— u in 
Cj, so, we can remove y ^ x u from Cj and get a new completed PDAG 
whose skeleton is a subgraph of the skeleton of the initial graph. Denote 
the resulting completed PDAG as Ck, it may still contain some undirected 
edges. 

By repeatedly applying the above the steps in sequence, we can finally 
obtain a graph without any edges. 



3.2. Proof of Theorem 2 introduced in Subsection 2.3. There are three 
statements in Theorem 2; we prove them one by one below. 
Proof of (i) of Theorem 2 



Figure 1 shows the four cases that ensure that an edge is strongly pro- 
tected. We first show that for any edge x ^ u (or y ^ u) , where u is & 
common child of x and y, if x — >■ it is strongly protected in Vt+i by con- 
figuration (a), (6), or (d) in Figure 1 (replace u ^ n by x — >■ u), it is also 
directed in et+i. 

Case (1), (2) and (3) in Figure 12 show the sub-structures of Vt+i in 
which x — )• tt is protected by case (a) , (5) and (d) in Figure 1 respectively, 
where Vt+i is the modified graph obtained by inserting x — y into e^. 



□ 



(If) 
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Fig 12. strongly protected in Vt+i 



If X — ^ « is protected in Vt+i like case (1) in Figure 12, w ^ x ^ u occurs 
and w and u are not adjacent in Vt+i. li w x is undirected in e^+i, from 
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Lemma 14, there exists a directed path from y to x. Any parent of x that 
is in this path must not be a parent of y\ otherwise, there exists a directed 
cycle from y to y in e^. Hence we have that the parent sets of y and x are 
not equal. This is a contradiction of the condition = liy in Lemma 3. We 
have that — >■ x and x — >■ u occur in ej+i. 

If X — >■ -u is protected in Vt+\ by v-structure x ^ u w, like case (2) in 
Figure 12, clearly, the v-structure also occurs in et+i, so x ^ u occurs in 
et+i- 

If X — )• u is protected in Vi like case (3) in Figure 12, we have that the 
v-structure — >■ u ■<— lui also occurs in et+\. If either x — u or u — >■ x is in 
e^+i, wc have that wi ^ x and w ^ x are both in e^+i and the v-structure 
wi ^ X w occurs. Hence we have have that x ^ u occur in et+i- 

Now we show that if x — >■ w is protected in Vt+i like (c) in Figure 1 , it is 
also protected in et+i- For any ui in x — >■ -ui — >■ u, there are only two cases: 
ui and y are adjacent or nonadjacent. 

When ui and y arc not adjacent, like (4) in Figure 12, there is a v-structurc 
ui ^ u y in Vt+i- Then ui u occurs in et+i- If x — « occurs in et+i, 
by Lemma 12, the edge between x and ui must be directed and oriented as 
iti — 7- X in Ct+i- This is impossible, because there exists some extension of 
Vt+i that has an edge oriented as x — > tti. Thus, x — )• tt occurs in ej+i. 

When ui and y are adjacent, we have that ui y and ui — y do not 
occur in Vt+i since Px = Py must hold in et for the validity of the operator 
InsertU x — y. Hence wc have that y ^ ui occurs in Vt+i and x ^ u is 
strongly protected like case (5) in Figure 12. We consider two cases: x ^ ui 
occurs or does not occur in et+i- 

Assume x ui occurs in et+i- If ui — >■ u occurs in et+i, clearly, x u 
must occur in et+i because there is a partially directed path x — )■ ni — )■ u in 
et+i. If ui ^ u is undirected in et+i, from Lemma 12, x ^ u must occur in 
et+i. 

In case (5), we have that ui is also a common child of x and y, so, x — > ui 
will also be strongly protected in Vt+i from the condition iu^. Now, consider 
X —7- ui; if it is protected in Vt+i like any of case (1), (2), (3), or (4), then, 
by our proof, x — )• «i occurs in et+i- Thus, x — )• it must occur in et+i- If 
X — >■ ui is protected in Vt+i like case (5), we can find another vertex U2 that 
is a common child of x and y like case (6). From the proof above, we know 
if X — )• U2 occurs in et+i, x — > and x — > u also occur in et+i- Since the 
graph has finite vertices, we can find a common child of x and y, say Uk, 
such that X ^ Uk is protected in Vt+i like one of cases (1), (2), (3) or (4). 
Thus, X ^ Uk occurs in et+i, implying that x — >■ Uk-i occurs in Vt+i, so, 
finally, x ^ u occurs in Vt+i- 



24 



Y.B. HE ET AL. 



(Only if) Prom Lemma 15, we have that the modified graph Vt+i is also 
the resulting completed PDAG et+i- Hence, all directed edges in et+i are 
strongly protected in Vt+i, so the Algorithm 1.1.1 will return True. 

□ 

Proof of (ii) of Theorem 2 
To prove (ii) of Theorem 2, we need following lemma. 

Lemma 21. Let et be a completed PDAG, Vt+i he the PDAG obtained 
in Algorithm 1.1.2 with input of a valid operator InsertD x y, and et+i 
be the resulting completed PDAG extended from Vt+i- We have: 

1. If u is not a common child of x and y, then all directed edges y ^ u 

in Vt+i are also in et+i. 

2. All directed edges v y in Vt+i are also in Cf+i; 

Proof. (1) 

If u is not a common child of x and y, and y ^ u occurs in Vt+i, wc have 
that there is a structure like x ^ y — >• u in Vt+i. Because x ^ y occurs in 
et+i, y ^ u must be in et+i too. 

(2) 

From Algorithm 1.1.2, all directed edges v y are strongly protected in 
Vt+i- When v is not adjacent to x in et+i, u — )■ y x is a v-structure, so 
V y occurs in ct+i. When v is adjacent to x, we show below that if v — )• y 
is strongly protected like one of four cases in Figure 13, it is also strongly 
protected in et+i. 




Fig 13. strongly protected m Vt+i- 

In case (1) of Figure 13, because there is no path from y to we have that 
w ^ V occurs in e^+i from Lemma 14. Hence we have that v y occurs in 
et+i- 

In case (2), there is a v-structure w ^ y v in Vt+i- So, f — )■ y occurs 
in et+i. 

In case (3), because there is no path from y to u, we have that v ^ u 
occurs in et+i according to Lemma 14. llu ^ y occurs in ej+i, v ^ y occurs 
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in et+i- If tt — )• y become u — y in et+i, f — )• y must also be in in et+i from 
Lemma 12. 

From the proof of (i) of Theorem 2, we also have that v — >■ y must be in 
et+i when case (4) occurs in Vt+i- 

Notice that the above proof also holds when we replace x — vhj a directed 
edge or add an edge between x and w{ or u). Hence we have that v y in 
Vt+i also occurs in et+\. □ 

We now give a proof for (ii) of Theorem 2. 
(If) 

We need to consider four cases in Figure 1 in which y — t- u is strongly 
protected in Vt+i- Similar to the proof of (i) of Theorem 2, we first prove 
that the theorem holds in the first three cases in Figure 1, which correspond 
to the cases (1)', (2)' and (3)' shown in Figure 14. Notice that the following 
proof holds for any configuration of the edge between x and w. 




Fig 14. Five cases in which x u or y ^ u is strongly protected. 

Consider the case (1)' in Figure 14. From Lemma 21, w ^ y occurs in 
et+i. We have that x u must occur in e^+i. 

Because there is a v-structure w — > u y in case (2)', we have that 
w u y also occurs in et+i ■ 

After implementing Algorithm 1.1.2, if case (3)' occurs in Vt+i, we have 
that y — w is not strongly protected in Vt+i and the edge between y and 
w have opposite directions in different consistent extensions of Vt+i- Hence 
y — w occurs in et+i- Similarly, y — wi also occurs in et+i- Moreover, the 
v-striicturc w u -(^ wi occurs in et+i- We have that y — >■ -u is strongly 
protected and occurs in Ct+i- 

We now just need to show that a directed edge y ^ u that is strongly 
protected in Vt+i like case (4)' {x and ui are nonadjacent) or (4)" {x and 
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ui are adjacent) in Figure 14 is also directed in et+i- 

In case (4)', from delete Lemma 21, y — > ui occurs in et+i- Moreover, 
X — u ui is a v-structure, so ui u also occurs in Ci. So we have y u 
must occur in et+i- 

In case (4)", we have that Ui is also a common child of x and y; hence, 
y ^ u\ will also be strongly protected in Vt+i from the condition of this 
Theorem. Consider y — t- ui; if it is protected in Vt+i like at least one case 
other than (4)", from our proof, y — > ui is also compelled in e^+i, so y — )■ ti 
must be compelled in e^+i. If y — ^ ui is protected in Vt+i like case (4)", we 
can find another vertex U2 that is a common child of y and x\ from the proof 
above, we know if y — t- n2 is directed in e^+i, y — t- ui and y ^ u are directed 
too. Since the graph has finite vertices, we can find a common child of x and 
y, say Uk, such that Uk is protected in Vt+i like at least one case other than 
(4)". It is compelled in e^+i, so we can get y — >■ u^-i is compelled in Vt+i-, 
so, finally, y — u is also compelled in Vt+i- We have that y u must occur 
in et+i and ids holds. 

(Only if)Let u be a common child of x and y in e^. If condition ids 
holds for a valid operator InsertD x ^ y, we have that y ^ n in occurs 
in et+i and is strongly protected in e^+i. We need to show that y — )■ u 
must be strongly protected in Vt+i, obtained in Algorithm 1.1.2. From the 
proof of this statement above, we know we just need to consider the five 
configurations in which y — >■ u is strongly protected in et+i in Figure 14. 

We know that v-structures in et+i occur in Vt+i therefore, the v-structure 
in the cases (2)', (3)' and (4)' in et+i must occur in Vt+i too. 

For case (2)', y u is also strongly protected in Vt+i, since the v- 
structure y u <— w occurs in Vt+i ■ 

For case (3)', we have that (1) the v-structure wi ^ u w occurs in 
Vt+i', (2) et+i and Vt+i have the same set of v-structures. Hence the v- 
structure u^i — )• y u) does not occur in Vt+i- We have that y — )■ u is also 
strongly protected in Vt+i for any configuration of edges between wi , y and 
w. 

For case (4)', from Algorithm 1.1.2, y ^ u\ occurs in Vt-\-i- Hence y ^ u 
is strongly protected in Vt+i- 

Because the valid operator "Insert x y" satisfies condition ids, from 
Lemma 8, we have that the operator "Delete x y" , when applied to et+i, 
results in ej. From the condition dd2, any directed edge t; — t- y in et+i also 
occurs in et- For case (1)', we have that v ^ y ^ u is strongly protected in 
Vt+i. 

Consider the case (4)", we have that v-structures x ^ u ^ y and x 
ui y occur in et since et is the resulting completed PDAG of the operator 
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"Delete x — >■ y" from et+i. According to Algorithm 1.1.2, x^y,x^u^y 
and X ^ u\ ^ y occur in Vt+i- We have that u ^ u\ does not occur in 
et, otherwise u ^ ui occurs in at least one consistent extension of Vt+i and 
consequently u\ ^ u does not occur in et+\. To prove that y — > u is strongly 
protected in e^+i, we need to show that Ui — >■ u occurs in et- Equivalently, 
we show ui — u does not occur in et- ui — u occurs in a chain component 
denoted by r in e^, wc have that neither x nor y are in r. The undirected 
edges adjacent to x or y are in chain components different to r. Hence ids 
holds for the operator "Insert x — > y" , and all parents of r occur in e^+i too. 
We have that u\ — u occurs in ej+i too. It's a contradiction that ui ^ y 
occurs in et-\-i. □ 
Proof of (iii) of Theorem 2 
(If) 

Since Algorithm 1.1.3 returns True, all directed edges like u — > y are 
strongly protected in Vt+i- Consider the four configurations in which f — t- y 
is strongly protected in Vt+i in Figure 15. Notice that Vt+i is obtained by 
deleting a; — > y from completed PDAG C, by Lemma 17, all directed edges 
with no vertices being descendants of y (excluding y) in Vt+i will occur in 
et- 

Hence, we have the edges w ^ v in case (1), and v ^ w in case (3) will 
remain in ej+i. We have v y in case (1) and case (3) must occur in et+i- 
Because v-structures in case (2) and case (4) will also remain in ej+i, v — >■ y 
in case (2) and case (4) must occur in et+i too. 

w 

/\ 

(1) : V *~y(2):v ^2/(3) : w (4) : w ► y, (w 7^ wi) 

/ \ / \ 

W W Wl 



Fig 15. Four configurations of v ^ y being strongly protected. 

(Only if) If condition dd2 holds for a valid operator DeleteD x — >■ y, 
all edges like v y {v ^ x) in et will occur in ct+i- v y must be 
strongly protected in et+i- Consider the four configurations in which u — >■ y 
is strongly protected in et+i as Figure 15. We know that v-structures in e^+i 
must occur in e^; consequently, all directed edges in et+i must occur in et; 
they also occur in Vt+i- Prom Lemma 17, w — v — wi in case (4) in Figure 
15 must be in Vt+i, so an edge v y that is strongly protected in et+i is 
also strongly protected in Vt+i- 
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